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10. Amethod for | Without conceding that the preamble of claim 10 of the ‘800 Patent is limiting, the Lenovo 
buffering datain | IdeaPad Duet 3 Chromebook (hereinafter, the “Lenovo product”) performs a method for 


an integrated buffering data in an integrated circuit having a plurality of processing modules being connected 
circuit having a with an interconnect through interface units, wherein a first processing module communicates to 
plurality of a second processing module using transactions), either literally or under the doctrine of 
processing equivalents. 


modules being 
connected with an | The Lenovo product includes an integrated circuit. For example, the Lenovo product includes the 
interconnect Qualcomm Snapdragon 7c Gen 2 Compute Platform system on chip (hereinafter, the “Snapdragon 
through interface | SoC”). 

units, wherein a 
first processing 
module 
communicates to a 
second processing 
module using 
transactions, the 
method 
comprising the 
acts of: 


1 The Lenovo product is charted as a representative product made used, sold, offered for sale, and/or imported by Lenovo. The citations to evidence contained herein are illustrative 
and should not be understood to be limiting. The right is expressly reserved to rely upon additional or different evidence, or to rely on additional citations to the evidence cited 
already cited herein. 
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Lenovo IdeaPad Duet 3 
Chromebook 


Featuring a Snapdragon 7c Gen 2 Compute Platform 


The Lenovo IdeaPad” Duet 3 Chromebook is the ideal work 


and play device for the hyper-mobile user looking for superior 


experience with the larger 11” 2K near-borderless display. 
Faster connectivity options, all-day battery life, and the more 
powerful, fanless and efficient performance of the 


Snapdragon’® 7c Gen 2 platform gets things done while on the 


go. Work on the detachable keyboard or take notes and 
sketch with the optional Lenovo USI Pen 2. 


Learn More 


finder /lenovo-ideapad-duet-3-chromebook 


The Snapdragon SoC comprises a plurality of processing modules, for example Qualcomm Adreno 
GPU; Octa-core Qualcomm Kryo 468 CPU; and Qualcomm Hexagon 692 DSP: 
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Qualcomm’ Snapdragon”™ 


7c Gen 2 Compute Platform Sheshtetay 


Specifications & Features 


CPU Video + Uplink Technology: Qualcomm* 
—_—_——S=—=—=—= —_—_—_—  ____ Snapdragon” Upload+ 


+ CPU Clock Speed: Up to 255 GHz * Video Playback: Up to 4K HDRIO = Uplink Caner Aggregation: 2:20 Miz canter 


+ CPU Cores: Octa-core Qualcomm” Kryo™ * Codec Support: H.265 (HEVC), H.264 (AVC), aggregation 
pissed ; sided ; + Uplink QAM: Up to 64-QAM 
+ CPU Architecture: 64-bit * Video Software: Motion Compensated 
Temporal Filtering (MCTF) * LTE Speed 
Process + LTE Peak Download Speed: 600 Mbps 
+ Process Technology: 8 nm SS Wi-Fi 
* Max On-Device Display: QXGA @ 60Hz, 
OS Support FHD @ 60Hz + Wi-Fi Standards: 802.Nac Wave 2, 
Se - T q A} 
+ Supports Windows 10 and Windows 11 * Max Extemal Display: QHD @ 60Hz es wii ome 
= pile pm + Display Pixels: 2560x1440, 2048x1536 + Wé-Fi Spectral Bands: 24 GHz, 5 GHz 
+ MIMO Configuration: 2x2 (2-stream) 
Memory General Audio + Qualcomm* FastConnect” Subsystem 
+ Memory Type: 2 x 16-bit, LPDDR&x-4266 + Qualcomm Agstic technology: Qualcomm - 
hdc " Agstic” audio codec, Qualcomm Agstic Bluetooth Version 
Storage smart speaker amplifier + Bluetooth 5.0 
* Qualcomm” aptX” audio playback support: 
+ UFS: eMMC 5); UFS 21 aptX, aptX HD P GPS Location 
Visual Subsystem Audio Playback + Satellite Systems Support: NaviC, BeiDou, 
7 aa ee — Galileo, GLONASS, GPS, QZSS, SBAS 
* GPU: Qualcomm* Adreno” GPU + PCM, Playback: Up to 384kH2/32bit 
Conner + Additional Playback Features: Native DSD Security 
in = a a Support + Qualcomm* Processor Security 


+ Image Signal Processor: Qualcomm e - : 
Spectra” 255 image signal processor, 14-bit Qualcomm’ Al Engine yaacnacaal Content Protection 
+ Dual Camera, ZSL, 30fps: Up to 16 MP + AIE CPU: Octa-core Kryo 468 CPU > W6Fi Seourty: WPAS 
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* AO 0 iGYOOCK N ve 


Camera ues. 


support 


* Qualcomm’ Processor Security 


* Image Signal Processor: Qualcomm Pee 
Spectra” 255 image signal processor, 14-bit Qualcomm’ Al Engine Qualeomm* Content Protection 
: - Wi-Fi Security: WPA3 


* Dual Camera, ZSL, 30fps: Up to 16 MP » AIE CPU: Octa-core Kryo 468 CPU 

* Single Camera, ZSL, 30fps: Up to 32 MP * AIE GPU: Adreno GPU 

* Camera Features: Multi-frame Noise + AIE DSP: Qualcomm" Hexagon” 692 DSP 
Reduction (MFNR) 

+ Video Capture Features: Rec. 2020 color Cellular Modem 


gamut video capture, Up to 10-bit color 


depth video capture * Modem Name: Snapdragon X15 LTE modem 


* LTE Category 


CAMERA FEATURES * Downlink LTE Category: LTE Category 12 
* Advanced DPD, WPA3 * Uplink LTE Category: LTE Category 13 
+ Multi-Frame Noise Reduction (MFNR) and * LTE Downlink Features 

Multi-Framme Super Resolution (MFSR) * Downlink Carrier Aggregation: 3x20 MHz 
* Forward-looking Electronic Image camer cggregation 

Stabilization (EIS) * Downlink LTE MIMO: Up to 4x4 MIMO on 
* Motion Compensated Temporal filtering two carriers 

(MCTF) for noise-free video capture up to * Downlink QAM: Up to 256-QAM, Up to 
+ Four MIPI CSI PHYs (DPHY 1.2 / CPHY 1.2) - LTE Uplink Features 


https:/ /www.qualcomm.com/content/dam/qcomm-martech/dm- 


assets /documents/prod_brief_qcom_sd7c_gen2.pdf 


The Snapdragon SoC included in the Lenovo product utilizes Arteris network on chip 
interconnect technology, and/or a derivative thereof, (collectively, the “ Arteris NoC”) as an 
interconnect to connect the plurality of processing modules through interface units: 
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Qualcomm 


QuALCOMW\ 


Arteris-developed NoC technology is the 
backbone of Snapdragon application 
processors & LTE modems, Atheros 
wireless connectivity SoCs, and CSR loT 
products. 


LEARN MORE » 


https: / /web.archive.org/web/20210514110614/https:/ /www.arteris.com/ customers 
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Certain Arteris Technology Assets Acquired 


by Kurt Shuler, on October 31, 2013 


Arteris to continue to license, support and maintain Arteris FlexNoC® interconnect IP 


SUNNYVALE, California — October 31, 2013 — Arteris Inc., a leading innovator and supplier of silicon-proven 
commercial network-on-chip (NoC) interconnect IP solutions, today announced that Qualcomm Technologies, 
Inc. (‘Qualcomm’), a subsidiary of Qualcomm Incorporated, has acquired certain technology assets from Arteris 
and hired personnel formerly employed by Arteris. 


GG Arteris NoC technology has been and will continue to be a key enabler for 
creating larger and more complex chips in a shorter amount of time at a 
lower cost. This acquisition of our technology assets represents a validation 
of the value of Arteris’ Network-on-Chip interconnect IP technology. 


ARTERISia 


K. Charles janac, President and CEO, Arteris 


https://www.arteris.com/ press-releases /Qualcomm-Arteris-asset-acquisition-2013_oct_31; 
https:/ / www .fiercewireless.com/tech/qualcomm-acquires-arteris-noc-tech-assets-team 


A large SoC, such as the Snapdragon SoC included in the Lenovo product may include multiple 
classes of Arteris NoC interconnect: 
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Logical Interconnect Topology Development 


FLEXNOC & NCORE INTERCONNECT IPS DEFINE ARCHITECTURES 


Ncore Cache Coherent NoC 
fuss ZEECELEE 


F firewall 


PSs 


‘Axoid+ 
n 


Pel ~=—-s Cache Coherent es 
Interconnect 


1 
P) OBS. 


A 
2) i 
Do o1 a 
io} 


fe) TF] 
Memory NoC Sched 
DRAM 


| sRaw DRAM DRAM DRAM 


e ArChip16 Example: Large SoCs have multiple classes of interconnect 
— Non-coherent, Coherent, Control/Status, Observability, etc. 
e Necore & FlexNoC interconnects are managed separately from IP blocks, increasing design flexibility 


ARTER isi ISPD 2018, 28 March 2018 Copyright © 2018 Arteris 1P | 9 
See Physical Interconnect Aware Network Optimizer, http:/ /www.ispd.cc/slides/2018/s7_2.pdf, 
at slide 9. 


The Arteris NoC is an interconnect connects the plurality of processing modules in the 
Snapdragon SoC included in the Lenovo product through interface units, wherein a first 
processing module communicates to a second processing module using transactions. 


For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
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NoC, “[mlJost transactions require the following two-step transfers,” including “[a] master 
send[ing] request packets” and “the slave return[ing] response packets”: 


11.3.1.1 Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shownin Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 


on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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FIGURE 11.1 
NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313; see id at 308 
(explaining that Chapter 11 of this book describes the function of the Arteris NoC: “In this chapter 
we will present an MPSoC platform [...] using Arteris NoC as communication infrastructure.”). 


configuring the 
first processing 
module having a 
first memory asa 


The Arteris NoC utilized by the Snapdragon SoC included in the Lenovo product configures the 
first processing module having a first memory as a master the provides requests, either literally or 
under the doctrine of equivalents. 
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master the For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
provides requests; | third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
NoC, “[mlJost transactions require the following two-step transfers,” including “[a] master 
send[ing] request packets” and “the slave return[ing] response packets”: 


11.3.1.1 Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 


12 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Initiator NIUs are “used to connect a master node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As a further example, “Initiator NIU units...enable connection between an AMBA-AHB master IP 
and the NoC [and] translate[] AHB transactions AHB transactions into an equivalent NTTP packet 
sequence, and transports requests and responses to and from a target NIU, that is, slave IP” and 
has a “FIFO memory [...] inserted in the datapath for AHB write access”: 
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11.3.2.1 Initiator NIU Units 


Initiator NIU units (the architecture of the AHB initiator is given in Figure 
11.4) enable connection between an AMBA-AHB master IP and the NoC. 
It translates AHB transactions into an equivalent NTTP packet sequence, 
and transports requests and responses to and from a target NIU, that is, 
slave IP (slave can be any of the supported protocols). The AHB-to-NTTP 
unit instantiates a Translation Table for address decoding. This table receives 
32-bit AHB addresses from the NIU and returns the packet header and necker 
information that is needed to access the NTTP address space: Slave address, 
Slave offset, Start offset, and the coherency size (see Figure 11.2). Whenever 
the AHB address does not fit the predefined decoding range, the table as- 
serts an error signal that sets the error bit of the corresponding NTTP request 
packet, for further error handling by the NoC. The translation table is fully 
user-defined at design time: it must first be completed with its own hardware 
parameters, then passed to the NIU. 

A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 
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burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


configuring the The Arteris NoC utilized by the Snapdragon SoC included in the Lenovo product configures the 
second processing | second processing module having a second memory as a slave the provides responses to the 
module havinga ___| requests, either literally or under the doctrine of equivalents. 

second memory as 
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a slave the For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
provides third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
responses to the NoC, “[mlJost transactions require the following two-step transfers,” including “[a] master 
requests; send[ing] request packets” and “the slave return[ing] response packets”: 


11.3.1.1 Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Target NIUs are “used to connect a slave node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As further example, “Target NIU units enable connection of a slave IP to the NoC by translating 
NTTP packet sequences into equivalent packet transactions, and transporting requests and 
responses to and from targets” and have a FIFO memory in the datapath: 
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11.3.2.2 Target NIU Units 


Target NIU units enable connection of a slave IP to the NoC by translat- 
ing NTTP packet sequences into equivalent packet transactions, and trans- 
porting requests and responses to and from targets (the architecture of the 
AHB Target NIU is given in Figure 11.5). For the AHB target NIU, the AHB 
address space is mapped from the NTTP address space using the slave offset, 
the start/stop offset, and the slave address fields, when applicable (from the 
header of the request packet, Figure 11.2). The AHB address bus is always 


32 bits wide, but the actual address space size may be downsized by setting a 
hardware parameter. Unused AHB address bits are then driven to zero. The 
NTTP request packet is then translated into one or more corresponding AHB 
accesses, depending on the transaction type (word aligned or nonaligned ac- 
cess). For example, if the request is an atomic Store, or a Load that can fit an 
AHB burst of specified length, then such a burst is generated. Otherwise, an 
AHB burst with unspecified length is generated. 
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Network interface unit: Target architecture. 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 318-319. 


connecting the 
master to a master 


The Arteris NoC utilized by the Snapdragon SoC included in the Lenovo product connects the 
master to a master interface unit of the interface units, either literally or under the doctrine of 


equivalents. 
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interface unit of 
the interface units; | For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
master and slave nodes: 


11.3.1.1 Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Initiator NIUs are “used to connect a master node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 

¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As a further example, “Initiator NIU units...enable connection between an AMBA-AHB master IP 
and the NoC”: 
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11.3.2.1 Initiator NIU Units 


Initiator NIU units (the architecture of the AHB initiator is given in Figure 
11.4) enable connection between an AMBA-AHB master IP and the NoC. 
It translates AHB transactions into an equivalent NTTP packet sequence, 
and transports requests and responses to and from a target NIU, that is, 
slave IP (slave can be any of the supported protocols). The AHB-to-NTTP 
unit instantiates a Translation Table for address decoding. This table receives 
32-bit AHB addresses from the NIU and returns the packet header and necker 
information that is needed to access the NTTP address space: Slave address, 
Slave offset, Start offset, and the coherency size (see Figure 11.2). Whenever 
the AHB address does not fit the predefined decoding range, the table as- 
serts an error signal that sets the error bit of the corresponding NTTP request 
packet, for further error handling by the NoC. The translation table is fully 
user-defined at design time: it must first be completed with its own hardware 
parameters, then passed to the NIU. 

A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 
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burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


connecting the 
master interface 
unit to the 


The Arteris NoC utilized by the Snapdragon SoC included in the Lenovo product connects the 
master interface unit to the interconnect so that the master interface unit is between the master 
and the interconnect, either literally or under the doctrine of equivalents. 
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interconnect so 


that the master For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
interface unit is third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
between the NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
master and the master and slave nodes, between the nodes and the network: 

interconnect; 


11.3.1.1 Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Initiator NIUs are “used to connect a master node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 

¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As a further example, “Initiator NIU units...enable connection between an AMBA-AHB master IP 
and the NoC”: 
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11.3.2.1 Initiator NIU Units 


Initiator NIU units (the architecture of the AHB initiator is given in Figure 
11.4) enable connection between an AMBA-AHB master IP and the NoC. 
It translates AHB transactions into an equivalent NTTP packet sequence, 
and transports requests and responses to and from a target NIU, that is, 
slave IP (slave can be any of the supported protocols). The AHB-to-NTTP 
unit instantiates a Translation Table for address decoding. This table receives 
32-bit AHB addresses from the NIU and returns the packet header and necker 
information that is needed to access the NTTP address space: Slave address, 
Slave offset, Start offset, and the coherency size (see Figure 11.2). Whenever 
the AHB address does not fit the predefined decoding range, the table as- 
serts an error signal that sets the error bit of the corresponding NTTP request 
packet, for further error handling by the NoC. The translation table is fully 
user-defined at design time: it must first be completed with its own hardware 
parameters, then passed to the NIU. 

A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 
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burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


connecting the The Arteris NoC utilized by the Snapdragon SoC included in the Lenovo product connecting the 
slave to aslave slave to a slave interface unit of the interface units, either literally or under the doctrine of 
equivalents. 
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interface unit of 
the interface units; | For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
master and slave nodes: 


11.3.1.1 Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Target NIUs are “used to connect a slave node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As further example, “Target NIU units enable connection of a slave IP to the NoC by translating 
NTTP packet sequences into equivalent packet transactions, and transporting requests and 
responses to and from targets”: 
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11.3.2.2 Target NIU Units 


Target NIU units enable connection of a slave IP to the NoC by translat- 
ing NTTP packet sequences into equivalent packet transactions, and trans- 
porting requests and responses to and from targets (the architecture of the 
AHB Target NIU is given in Figure 11.5). For the AHB target NIU, the AHB 
address space is mapped from the NTTP address space using the slave offset, 
the start/stop offset, and the slave address fields, when applicable (from the 
header of the request packet, Figure 11.2). The AHB address bus is always 


32 bits wide, but the actual address space size may be downsized by setting a 
hardware parameter. Unused AHB address bits are then driven to zero. The 
NTTP request packet is then translated into one or more corresponding AHB 
accesses, depending on the transaction type (word aligned or nonaligned ac- 
cess). For example, if the request is an atomic Store, or a Load that can fit an 
AHB burst of specified length, then such a burst is generated. Otherwise, an 
AHB burst with unspecified length is generated. 
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Network interface unit: Target architecture. 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 318-319. 
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connecting the The Arteris NoC utilized by the Snapdragon SoC included in the Lenovo product connects the 
slave interface unit | slave interface unit to the interconnect so that the slave interface unit is between the slave and the 
to the interconnect | interconnect, either literally or under the doctrine of equivalents. 

so that the slave 


interface unit is For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
between the slave | third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
and the NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
interconnect; master and slave nodes, between the nodes and the network: 


11.3.1.1_ Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shownin Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Target NIUs are “used to connect a slave node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As further example, “Target NIU units enable connection of a slave IP to the NoC by translating 
NTTP packet sequences into equivalent packet transactions, and transporting requests and 
responses to and from targets”: 
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11.3.2.2 Target NIU Units 


Target NIU units enable connection of a slave IP to the NoC by translat- 
ing NTTP packet sequences into equivalent packet transactions, and trans- 
porting requests and responses to and from targets (the architecture of the 
AHB Target NIU is given in Figure 11.5). For the AHB target NIU, the AHB 
address space is mapped from the NTTP address space using the slave offset, 
the start/stop offset, and the slave address fields, when applicable (from the 
header of the request packet, Figure 11.2). The AHB address bus is always 


32 bits wide, but the actual address space size may be downsized by setting a 
hardware parameter. Unused AHB address bits are then driven to zero. The 
NTTP request packet is then translated into one or more corresponding AHB 
accesses, depending on the transaction type (word aligned or nonaligned ac- 
cess). For example, if the request is an atomic Store, or a Load that can fit an 
AHB burst of specified length, then such a burst is generated. Otherwise, an 
AHB burst with unspecified length is generated. 
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FIGURE 11.5 
Network interface unit: Target architecture. 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 318-319. 


determining by a 
master 


The Arteris NoC utilized by the Snapdragon SoC included in the Lenovo product determines by a 
master determination unit of the master interface unit a first optimal amount of data to be 
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determination unit | buffered by a master wrapper of the master interface unit, either literally or under the doctrine of 


of the master equivalents. 
interface unit a 
first optimal For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 


amount of datato | third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
be buffered by a NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
master wrapper of | master and slave nodes, between the nodes and the network: 

the master 


ee: 11.3.1.1 Transaction Layer 
interface unit; 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shownin Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 


51 


4857-2658-6177.3 


Case 2:22-cv-00481-JRG Document 1-31 Filed 12/19/22 Page 52 of 114 PagelD #: 1478 


U.S. Patent No. 8,086,800 (Radulescu and Goossens) 


“Integrated circuit and method for buffering to optimize burst length in networks on chips” 


800 Patent Claim Lenovo Product Including Snapdragon System on Chip! 


Initiator 


NIU 


= Rx Tx 
=) 
o Request 
= Rg ackets 
[= Ye Pp 
S ’ PA 
an 
3 8 
=|2 . ~ 
alee oo 
fas} 
| 
zB Response — 
x ackets . 
& P 
Request network 
_-> 
Response network 
FIGURE 11.1 


NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Initiator NIUs are “used to connect a master node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


In the Arteris NoC “Initiator NIU units...enable connection between an AMBA-AHB master IP 
and the NoC” and includes blocks such as “Data FIFO,” “Translation Table,” “Build Header & 
Necker,” and “Packet Assembly”: 


me, 
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FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317. 


In the Initiator NIUs of the Arteris NoC, a “FIFO memory is inserted in the datapath for AHB 

write accesses. The FIFO memory absorbs data at the AHB initiator rate, so that NITTP packets can 

burst at NoC rate as soon as a minimum amount of data has been received.” “[T]he FIFO depth is 
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defined by the hardware parameter” which “indicates the amount of data required to generate a 
Store packet: each time the FIFO is full, a Request packet is sent on the Tx port”: 


11.3.2.1 Initiator NIU Units 


Initiator NIU units (the architecture of the AHB initiator is given in Figure 
11.4) enable connection between an AMBA-AHB master IP and the NoC. 
It translates AHB transactions into an equivalent NTTP packet sequence, 
and transports requests and responses to and from a target NIU, that is, 
slave IP (slave can be any of the supported protocols). The AHB-to-NTTP 
unit instantiates a Translation Table for address decoding. This table receives 
32-bit AHB addresses from the NIU and returns the packet header and necker 
information that is needed to access the NTTP address space: Slave address, 
Slave offset, Start offset, and the coherency size (see Figure 11.2). Whenever 
the AHB address does not fit the predefined decoding range, the table as- 
serts an error signal that sets the error bit of the corresponding NTTP request 
packet, for further error handling by the NoC. The translation table is fully 
user-defined at design time: it must first be completed with its own hardware 
parameters, then passed to the NIU. 

A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 
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burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


determining bya_ | The Arteris NoC utilized by the Snapdragon SoC included in the Lenovo product determines by a 

slave slave determination unit of the slave interface unit a second optimal amount of data to be buffered 

determination unit | by aslave wrapper of the slave interface unit, either literally or under the doctrine of equivalents. 
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of the slave 
interface unit a For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
second optimal third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
amount of datato | NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 

be buffered by a master and slave nodes, between the nodes and the network: 

slave wrapper of 
the slave interface 
unit; The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


11.3.1.1 Transaction Layer 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Target NIUs are “used to connect a slave node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As further example, “Target NIU units enable connection of a slave IP to the NoC by translating 
NTTP packet sequences into equivalent packet transactions, and transporting requests and 
responses to and from targets” and includes blocks such as “Data FIFO “and “Packet Assembly”: 
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11.3.2.2 Target NIU Units 


Target NIU units enable connection of a slave IP to the NoC by translat- 
ing NTTP packet sequences into equivalent packet transactions, and trans- 
porting requests and responses to and from targets (the architecture of the 
AHB Target NIU is given in Figure 11.5). For the AHB target NIU, the AHB 
address space is mapped from the NTTP address space using the slave offset, 
the start/stop offset, and the slave address fields, when applicable (from the 
header of the request packet, Figure 11.2). The AHB address bus is always 


32 bits wide, but the actual address space size may be downsized by setting a 
hardware parameter. Unused AHB address bits are then driven to zero. The 
NTTP request packet is then translated into one or more corresponding AHB 
accesses, depending on the transaction type (word aligned or nonaligned ac- 
cess). For example, if the request is an atomic Store, or a Load that can fit an 
AHB burst of specified length, then such a burst is generated. Otherwise, an 
AHB burst with unspecified length is generated. 
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FIGURE 11.5 
Network interface unit: Target architecture. 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 318-319. 
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In the Target NIUs of the Arteris NoC, similar to as described above for the Initiator NIUs, “[a] 
FIFO memoty is inserted in the datapath for AHB ... accesses. The FIFO memory absorbs data at 
the AHB ... rate, so that NITP packets can burst at NoC rate as soon as a minimum amount of 
data has been received.” “[T]he FIFO depth is defined by the hardware parameter” which 
“indicates the amount of data required to generate a ... packet: each time the FIFO is full, a... 
packet is sent on the Tx port”: 


A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 


burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


buffering by the The Arteris NoC utilized by the Snapdragon SoC included in the Lenovo product buffers by the 
slave wrapper of | slave wrapper of the slave interface unit data from the slave to be transferred over the 

the slave interface | interconnect until a first optimal amount of data is buffered, either literally or under the doctrine 
unit data from the | of equivalents. 


slave to be 

transferred over 

the interconnect For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
until a first third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
optimal amount of | NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
data is buffered; master and slave nodes, between the nodes and the network: 


11.3.1.1 Transaction Layer 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shownin Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Target NIUs are “used to connect a slave node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As further example, “Target NIU units enable connection of a slave IP to the NoC by translating 
NTTP packet sequences into equivalent packet transactions, and transporting requests and 
responses to and from targets” and includes blocks such as “Data FIFO ”and “Packet Assembly”: 
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11.3.2.2 Target NIU Units 


Target NIU units enable connection of a slave IP to the NoC by translat- 
ing NTTP packet sequences into equivalent packet transactions, and trans- 
porting requests and responses to and from targets (the architecture of the 
AHB Target NIU is given in Figure 11.5). For the AHB target NIU, the AHB 
address space is mapped from the NTTP address space using the slave offset, 
the start/stop offset, and the slave address fields, when applicable (from the 
header of the request packet, Figure 11.2). The AHB address bus is always 


32 bits wide, but the actual address space size may be downsized by setting a 
hardware parameter. Unused AHB address bits are then driven to zero. The 
NTTP request packet is then translated into one or more corresponding AHB 
accesses, depending on the transaction type (word aligned or nonaligned ac- 
cess). For example, if the request is an atomic Store, or a Load that can fit an 
AHB burst of specified length, then such a burst is generated. Otherwise, an 
AHB burst with unspecified length is generated. 
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Target NIU Architecture 
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FIGURE 11.5 
Network interface unit: Target architecture. 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 318-319. 
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In the Target NIUs of the Arteris NoC, similar to as described above for the Initiator NIUs, “[a] 
FIFO memory is inserted in the datapath for AHB ... accesses. The FIFO memory absorbs data at 
the AHB ... rate, so that NITP packets can burst at NoC rate as soon as a minimum amount of 
data has been received.” “[T]he FIFO depth is defined by the hardware parameter” which 
“indicates the amount of data required to generate a ... packet: each time the FIFO is full, a... 
packet is sent on the Tx port”: 


A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 


burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


As a further illustration, the Arteris NoC uses “a mechanism called rated adaptation, which stalls 
packets just enough to remove wait states from the packets, preserving a low latency.” For other 
traffic, the “[b]est effort traffic can be left untouched[,]” “[l]atency sensitive traffic may have its 
urgency modulated as a function of the transaction[,]” “[s]oft real-time traffic may have its hurry 
level modulated as a function of the bandwidth it receives|,]” and “[o]n the real-time modem data 
port, the hurry is fixed at a critical level”: 


Those effects can be mended by the insertion of buffering. In the case of peak bandwidth 
reduction, a simple FIFO does the job: Busy states present at the output of the FIFO do 
not propagate back to the input until the FIFO is full. For a peak bandwidth increase, the 
situation is a bit more complex. In a FIFO, wait states present at the input are only absorbed 
when the FIFO is not empty. Arteris proposes a mechanism called rate adaptation, which 
stalls packets just enough to remove wait states from the packets, preserving a low latency. 

In this second step, the architecture is modified to introduce some buffering. In our ex- 
ample 760 bytes of memory have been distributed across the topology. Some have been put 
on existing links; some required the creation of new links. 


See Application driven network-on-chip architecture exploration & refinement for a complex SoC, 
https://www.arteris.com/hs-fs/hub/48858 /file-14363521- 


pdf/docs/springerappdrivennocarchitecture8.5x11.pdf, at pg.16. 


transferring the The Arteris NoC utilized by the Snapdragon SoC included in the Lenovo product transfers the 
buffered data from | buffered data from the slave wrapper to the master wrapper when said first optimal amount of 
the slave wrapper | data has been buffered by the slave wrapper, either literally or under the doctrine of equivalents. 
to the master 
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wrapper when For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
said first optimal | third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
amount of data NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 

has been buffered | master and slave nodes, between the nodes and the network: 

by the slave 


11.3.1.1 Transaction Layer 
wrapper; 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


As further example, “Target NIU units enable connection of a slave IP to the NoC by translating 
NTTP packet sequences into equivalent packet transactions, and transporting requests and 
responses to and from targets” and includes blocks such as “Data FIFO ”and “Packet Assembly”: 
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11.3.2.2 Target NIU Units 


Target NIU units enable connection of a slave IP to the NoC by translat- 
ing NTTP packet sequences into equivalent packet transactions, and trans- 
porting requests and responses to and from targets (the architecture of the 
AHB Target NIU is given in Figure 11.5). For the AHB target NIU, the AHB 
address space is mapped from the NTTP address space using the slave offset, 
the start/stop offset, and the slave address fields, when applicable (from the 
header of the request packet, Figure 11.2). The AHB address bus is always 


32 bits wide, but the actual address space size may be downsized by setting a 
hardware parameter. Unused AHB address bits are then driven to zero. The 
NTTP request packet is then translated into one or more corresponding AHB 
accesses, depending on the transaction type (word aligned or nonaligned ac- 
cess). For example, if the request is an atomic Store, or a Load that can fit an 
AHB burst of specified length, then such a burst is generated. Otherwise, an 
AHB burst with unspecified length is generated. 
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Target NIU Architecture 
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Network interface unit: Target architecture. 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 318-319. 
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In the Target NIUs of the Arteris NoC, similar to as described above for the Initiator NIUs, “[a] 
FIFO memory is inserted in the datapath for AHB ... accesses. The FIFO memory absorbs data at 
the AHB ... rate, so that NITP packets can burst at NoC rate as soon as a minimum amount of 
data has been received.” “[T]he FIFO depth is defined by the hardware parameter” which 
“indicates the amount of data required to generate a ... packet: each time the FIFO is full, a... 
packet is sent on the Tx port”: 


A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 


burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


buffering by the The Arteris NoC utilized by the Snapdragon SoC included in the Lenovo product buffers by the 
master wrapper of | master wrapper of the master interface unit data from the master to be transferred over the 

the master interconnect until a second optimal amount of data is buffered by the master wrapper, either 
interface unit data | literally or under the doctrine of equivalents. 

from the master to 
be transferred over | For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
the interconnect third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
until a second NoGC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
optimal amount of | master and slave nodes, between the nodes and the network: 

data is buffered by 
the master 
wrapper; The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


11.3.1.1 Transaction Layer 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shownin Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Initiator NIUs are “used to connect a master node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


In the Arteris NoC “Initiator NIU units...enable connection between an AMBA-AHB master IP 
and the NoC” and includes blocks such as “Data FIFO,” “Translation Table,” “Build Header & 
Necker,” and “Packet Assembly”: 
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FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317. 


In the Initiator NIUs of the Arteris NoC, a “FIFO memory is inserted in the datapath for AHB 

write accesses. The FIFO memory absorbs data at the AHB initiator rate, so that NITTP packets can 

burst at NoC rate as soon as a minimum amount of data has been received.” “[T]he FIFO depth is 
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defined by the hardware parameter” which “indicates the amount of data required to generate a 
Store packet: each time the FIFO is full, a Request packet is sent on the Tx port”: 


11.3.2.1 Initiator NIU Units 


Initiator NIU units (the architecture of the AHB initiator is given in Figure 
11.4) enable connection between an AMBA-AHB master IP and the NoC. 
It translates AHB transactions into an equivalent NTTP packet sequence, 
and transports requests and responses to and from a target NIU, that is, 
slave IP (slave can be any of the supported protocols). The AHB-to-NTTP 
unit instantiates a Translation Table for address decoding. This table receives 
32-bit AHB addresses from the NIU and returns the packet header and necker 
information that is needed to access the NTTP address space: Slave address, 
Slave offset, Start offset, and the coherency size (see Figure 11.2). Whenever 
the AHB address does not fit the predefined decoding range, the table as- 
serts an error signal that sets the error bit of the corresponding NTTP request 
packet, for further error handling by the NoC. The translation table is fully 
user-defined at design time: it must first be completed with its own hardware 
parameters, then passed to the NIU. 

A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 
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burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


As a further illustration, the Arteris NoC uses “a mechanism called rated adaptation, which stalls 
packets just enough to remove wait states from the packets, preserving a low latency.” For other 
traffic, the “[b]est effort traffic can be left untouched|[,]” “[l]atency sensitive traffic may have its 
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urgency modulated as a function of the transaction[,]” “[s]oft real-time traffic may have its hurry 
level modulated as a function of the bandwidth it receives|,]” and “[o]n the real-time modem data 
port, the hurry is fixed at a critical level”: 


Those effects can be mended by the insertion of buffering. In the case of peak bandwidth 
reduction, a simple FIFO does the job: Busy states present at the output of the FIFO do 
not propagate back to the input until the FIFO is full. For a peak bandwidth increase, the 
situation is a bit more complex. In a FIFO, wait states present at the input are only absorbed 
when the FIFO is not empty. Arteris proposes a mechanism called rate adaptation, which 
stalls packets just enough to remove wait states from the packets, preserving a low latency. 

In this second step, the architecture is modified to introduce some buffering. In our ex- 
ample 760 bytes of memory have been distributed across the topology. Some have been put 
on existing links; some required the creation of new links. 


See Application driven network-on-chip architecture exploration & refinement for a complex SoC, 
https://www.arteris.com/hs-fs/hub/48858 /file-14363521- 
pdf/docs/springerappdrivennocarchitecture8.5x11.pdf, at pg.16. 

transferring the The Arteris NoC utilized by the Snapdragon SoC included in the Lenovo product transfers the 
buffered data from | buffered data from the master wrapper to the slave wrapper when said second optimal amount of 


the master data has been buffered by the master wrapper, either literally or under the doctrine of equivalents. 
wrapper to the 
slave wrapper For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 


when said second | third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
optimal amount of | NoC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
data has been master and slave nodes, between the nodes and the network: 

buffered by the 
master wrapper, 
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11.3.1.1 Transaction Layer 

The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 


on their receive ports, Rx, translate requests so that they comply with the pro- 
tocol used by the target third-party IP node. When the target node responds, 
returning responses are again converted by the slave NIU into appropriate 
response packets, then delivered through the slave NIU’s Tx port to the 
response network. The network then routes the response packets to the re- 
questing master NIU, which forwards them to the initiator. At the transaction 
level, NIUs enable multiple protocols to coexist within the same NoC. From 
the point of view of the NTTP modules, different third-party protocols are 
just packets moving back and forth across the network. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https: 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Initiator NIUs are “used to connect a master node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


In the Arteris NoC “Initiator NIU units...enable connection between an AMBA-AHB master IP 
and the NoC” and includes blocks such as “Data FIFO,” “Translation Table,” “Build Header & 
Necker,” and “Packet Assembly”: 
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Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317. 


In the Initiator NIUs of the Arteris NoC, a “FIFO memory is inserted in the datapath for AHB 

write accesses. The FIFO memory absorbs data at the AHB initiator rate, so that NITTP packets can 

burst at NoC rate as soon as a minimum amount of data has been received.” “[T]he FIFO depth is 
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defined by the hardware parameter” which “indicates the amount of data required to generate a 
Store packet: each time the FIFO is full, a Request packet is sent on the Tx port”: 


11.3.2.1 Initiator NIU Units 


Initiator NIU units (the architecture of the AHB initiator is given in Figure 
11.4) enable connection between an AMBA-AHB master IP and the NoC. 
It translates AHB transactions into an equivalent NTTP packet sequence, 
and transports requests and responses to and from a target NIU, that is, 
slave IP (slave can be any of the supported protocols). The AHB-to-NTTP 
unit instantiates a Translation Table for address decoding. This table receives 
32-bit AHB addresses from the NIU and returns the packet header and necker 
information that is needed to access the NTTP address space: Slave address, 
Slave offset, Start offset, and the coherency size (see Figure 11.2). Whenever 
the AHB address does not fit the predefined decoding range, the table as- 
serts an error signal that sets the error bit of the corresponding NTTP request 
packet, for further error handling by the NoC. The translation table is fully 
user-defined at design time: it must first be completed with its own hardware 
parameters, then passed to the NIU. 

A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 
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burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


wherein at least In the Arteris NoC utilized by the Snapdragon SoC included in the Lenovo product, at least one of 

one of the first the first determination unit and the second determination unit is further configured to determine 

determination unit | an optimal moment for sending the data in said first wrapper or said second wrapper according 
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and the second 
determination unit 
is further 
configured to 
determine an 
optimal moment 
for sending the 
data in said first 
wrapper or said 
second wrapper 
according to 
communication 
properties of the 
communication 
between the 
master and the 
slave, wherein the 
communication 
properties include 
ordering of data 
transport, flow 
control including 
when a remote 
buffer is reserved 
for a connection, 
then a data 
producer will be 
allowed to send 
data only when it 


to communication properties of the communication between the master and the slave wherein the 
communication properties include ordering of data transport, flow control including when a 
remote buffer is reserved for a connection, then a data producer will be allowed to send data only 
when it is guaranteed that space is available for the produced data at the remote buffer, 
throughput where a lower bound on throughput is guaranteed, latency where an upper bound for 
latency is guaranteed, lossiness including dropping of data, transmission termination, transaction 
completion, data correctness, priority, and data delivery, either literally or under the doctrine of 
equivalents. 


For example, the Arteris NoC uses Network Interface Units (NIUs), which “translate[] between 
third-party [OCP, AMBA AHB, APB, and AXI protocols] and NTTP protocols” and in the Arteris 
NoGC, the NIUs “are at the boundary of the NoC” and there is a NIU connected to each of the 
master and slave nodes, between the nodes and the network: 


ee AS 


The transaction layer is compatible with bus-based transaction protocols used 
for on-chip communications. It is implemented in NIUs, which are at the 
boundary of the NoC, and translates between third-party and NTTP proto- 
cols. Most transactions require the following two-step transfers: 


Transaction Layer 


e A master sends request packets. 


e Then, the slave returns response packets. 


As shown in Figure 11.1, requests from an initiator are sent through the master 
NIU’s transmit port, Tx, to the NoC request network, where they are routed to 
the corresponding slave NIU. Slave NIUs, upon reception of request packets 
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Be eaaliain on their receive ports, Rx, translate requests so that they comply with the pro- 


i ilabl ; 
A es oe ‘" tocol used by the target third-party IP node. When the target node responds, 


aaa atthe vemos returning responses are again converted by the slave NIU into appropriate 
buffer, throughput response packets, then delivered through the slave NIU’s Tx port to the 
where a lower response network. The network then routes the response packets to the re- 
bound on — questing master NIU, which forwards them to the initiator. At the transaction 
moe es level, NIUs enable multiple protocols to coexist within the same NoC. From 


teed, ‘ ‘ : ; 
ae a on the point of view of the NTTP modules, different third-party protocols are 


upper bound for just packets moving back and forth across the network. 
latency is 
guaranteed, 
lossiness including 
dropping of data, 
transmission 
termination, 
transaction 
completion, data 
correctness, 
priority, and data 
delivery. 
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NTTP protocol layers mapped on NoC units and Media Independent NoC Interface—MINI. 


See Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 311, 312-313. 


The Initiator NIUs are “used to connect a master node to the NoC” and the Target NIUs are “used 
to connect a slave node to the NoC”: 
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11.3.2 Network Interface Units 


The Arteris Danube IP library includes NIUs for different third party pro- 
tocols. Currently, three different protocols are supported: AHB (APB), OCP, 
and AXI. For each protocol, two different NIU units can be instantiated: 


e Initiator NIU—third party protocol-to-NTTP, used to connect a 
master node to the NoC 


¢ Target NIUs—NTTP-to-third party protocol, used to connect a slave 
node to the NoC 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 316-317. 


In the Arteris NoC “Initiator NIU units...enable connection between an AMBA-AHB master IP 
and the NoC” and includes blocks such as “Data FIFO,” “Translation Table,” “Build Header & 
Necker,” and “Packet Assembly”: 
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FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317. 


In the Initiator NIUs of the Arteris NoC, a “FIFO memory is inserted in the datapath for AHB 

write accesses. The FIFO memory absorbs data at the AHB initiator rate, so that NITTP packets can 

burst at NoC rate as soon as a minimum amount of data has been received.” “[T]he FIFO depth is 
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defined by the hardware parameter” which “indicates the amount of data required to generate a 
Store packet: each time the FIFO is full, a Request packet is sent on the Tx port”: 


11.3.2.1 Initiator NIU Units 


Initiator NIU units (the architecture of the AHB initiator is given in Figure 
11.4) enable connection between an AMBA-AHB master IP and the NoC. 
It translates AHB transactions into an equivalent NTTP packet sequence, 
and transports requests and responses to and from a target NIU, that is, 
slave IP (slave can be any of the supported protocols). The AHB-to-NTTP 
unit instantiates a Translation Table for address decoding. This table receives 
32-bit AHB addresses from the NIU and returns the packet header and necker 
information that is needed to access the NTTP address space: Slave address, 
Slave offset, Start offset, and the coherency size (see Figure 11.2). Whenever 
the AHB address does not fit the predefined decoding range, the table as- 
serts an error signal that sets the error bit of the corresponding NTTP request 
packet, for further error handling by the NoC. The translation table is fully 
user-defined at design time: it must first be completed with its own hardware 
parameters, then passed to the NIU. 

A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 
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burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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FIGURE 11.4 

Network interface unit: Initiator architecture. 

Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


As further example, “Target NIU units enable connection of a slave IP to the NoC by translating 
NTTP packet sequences into equivalent packet transactions, and transporting requests and 
responses to and from targets” and includes blocks such as “Data FIFO “and “Packet Assembly”: 
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11.3.2.2 Target NIU Units 


Target NIU units enable connection of a slave IP to the NoC by translat- 
ing NTTP packet sequences into equivalent packet transactions, and trans- 
porting requests and responses to and from targets (the architecture of the 
AHB Target NIU is given in Figure 11.5). For the AHB target NIU, the AHB 
address space is mapped from the NTTP address space using the slave offset, 
the start/stop offset, and the slave address fields, when applicable (from the 
header of the request packet, Figure 11.2). The AHB address bus is always 


32 bits wide, but the actual address space size may be downsized by setting a 
hardware parameter. Unused AHB address bits are then driven to zero. The 
NTTP request packet is then translated into one or more corresponding AHB 
accesses, depending on the transaction type (word aligned or nonaligned ac- 
cess). For example, if the request is an atomic Store, or a Load that can fit an 
AHB burst of specified length, then such a burst is generated. Otherwise, an 
AHB burst with unspecified length is generated. 
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FIGURE 11.5 
Network interface unit: Target architecture. 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 318-319. 
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In the Target NIUs of the Arteris NoC, similar to as described above for the Initiator NIUs, “[a] 
FIFO memorty is inserted in the datapath for AHB ... accesses. The FIFO memory absorbs data at 
the AHB ... rate, so that NITP packets can burst at NoC rate as soon as a minimum amount of 
data has been received.” “[T]he FIFO depth is defined by the hardware parameter” which 
“indicates the amount of data required to generate a ... packet: each time the FIFO is full, a... 
packet is sent on the Tx port”: 


A FIFO memory is inserted in the datapath for AHB write accesses. The 
FIFO memory absorbs data at the AHB initiator rate, so that NTTP packets can 


burst at NoC rate as soon as a minimum amount of data has been received. 
The width of the FIFO and the AHB data bus is identical, and the FIFO depth 
is defined by the hardware parameter. This parameter indicates the amount of 
data required to generate a Store packet: each time the FIFO is full, a Request 
packet is sent on the Tx port. Of course, if the AHB access ends before the FIFO 
is full, the NTTP request packet is sent. Because AHB can only tolerate a single 
outstanding transaction, the AHB bus is frozen until the NTTP transaction 
has been completed. That is 


¢ During a read request, until the requested data arrives from the Rx 
port 

e During a nonbufferable write request, in which case only the last 
access is frozen and the acknowledge occurs when the last NTTP 
response packet has been received 


e When an internal FIFO is full 
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Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 317-318. 


As a further illustration, the “Arteris NTTP protocol is packet-based” and the packets, which have 
“header and necker cells [that] contain information relative to routing, payload size, packet type, 
and the packet target address,” are “transported to other parts of the NoC to accomplish the 
transactions that are required by foreign IP nodes”: 


11.3.1.2 Transport Layer 


The Arteris NTTP protocol is packet-based. Packets created by NIUs are trans- 
ported to other parts of the NoC to accomplish the transactions that are 
required by foreign IP nodes. All packets are comprised of cells: a header 
cell, an optional necker cell, and possibly one or more data cells (for packet 
definition see Figure 11.2; further descriptions of the packet can be found in 
the next subsection). The header and necker cells contain information relative 
to routing, payload size, packet type, and the packet target address. Formats 
for request packets and response packets are slightly different, with the key 
difference being the presence of an additional cell, the necker, in the request 
packet to provide detailed addressing information to the target. 


Id. at 313. 


As yet a further illustration, packets in the Arteris NoC are “delivered as words that are sent 
along links and “[o]ne link (represented in Figure 11.1) defines the following signals,” which 
include “the current priority of the packet used to define preferred traffic class (or Quality of 
Service)” and “[f]low control”: 
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¢ Data—Data word of the width specified at design-time. 

¢ Frm—When asserted high, indicates that a packet is being transmit- 
ted. 

e Head—When asserted high, indicates the current word contains a 
packet header. When the link-width is smaller than single (SGL), the 
header transmission is split into several word transfers. However, 
the Head signal is asserted during the first transfer only. 

e TailOfs—Packet tail: when asserted high, indicates that the current 
word contains the last packet cell. When the link-width is smaller 
than single (SGL), the last cell transmission is split into several word 
transfers. However, the Tail signal is asserted during the first transfer 
only. 

e Pres.—Indicates the current priority of the packet used to define 
preferred traffic class (or Quality of Service). The width is fixed 


during the design time, allowing multiple pressure levels within 
the same NoC instance (bits 3-5 in| Figure 11.2). 
¢ Vld—Data valid: when asserted high, indicates that a word is being 


transmitted. 


¢ RxRdy—Flow control: when asserted high, the receiver is ready to 
accept word. When de-asserted, the receiver is busy. 


Id. at 313-314. 
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As a further illustration, the Arteris NoC implements Quality of Service (QoS) to “provide[] a 
regulation mechanism allowing specification of guarantees on some of the parameters related to 
the traffic”; “QoS, which includes guarantees of throughput and/or latency, is achieved by 
exploiting the signal pressure embedded into the NTTP packet definition” where the “pressure 
signal can be generated by the IP itself and is typically linked to a certain level of urgency with 
which the transaction will have to be completed”; and the “pressure information will be 
embedded in the NTTP packet at the NIU level”: 


Quality of Service (QoS). The QoS is a very important feature in the inter- 
connect infrastructures because it provides a regulation mechanism allowing 
specification of guarantees on some of the parameters related to the traf- 
fic. Usually the end users are looking for guarantees on bandwidth and/or 
end-to-end communication latency. Different mechanisms and strategies have 
been proposed in the literature. For instance, in Aithereal NoC [11,24] pro- 
posed by NXP, a TDMA approach allows the specification of two traffic cat- 
egories [25]: BE and GT. 

In the Arteris NoC, the QoS is achieved by exploiting the signal pressure em- 
bedded into the NTTP packet definition (Figures 11.1 and 11.2). The pressure 
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signal can be generated by the IP itself and is typically linked to a certain level 
of urgency with which the transaction will have to be completed. For exam- 
ple, we can imagine associating the generation of the pressure signal when a 
certain threshold has been reached in the FIFO of the corresponding IP. This 
pressure information will be embedded in the NTTP packet at the NIU level: 
packets that have pressure bits equal to zero will be considered without QoS; 
packets with a nonzero value of the pressure bit will indicate preferred traffic 
class.* Such a QoS mechanism offers immediate service to the most urgent 
inputs and variables, and fair service whenever there are multiple contend- 
ing inputs of equal urgency (BE). Within switches, arbitration decisions favor 
preferred packets and allocate remaining bandwidth (after preferred packets 
are served) fairly to contending packets. When there are contending preferred 
packets at the same pressure level, arbitration decisions among them are also 
fair. 
The Arteris NoC supports the following four different traffic classes: 
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e Real time and low latency (RTLL)—TIraffic flows that require the 
lowest possible latency. Sometimes it is acceptable to have brief 
intervals of longer latency as long as the average latency is low. 
Care must be taken to avoid starving other traffic flows as a side 
effect of pursuing low latency. 


¢ Guaranteed throughput (GT)—Traffic flows that must maintain 
their throughput over a relatively long time interval. The actual 
bandwidth needed can be highly variable even over long intervals. 
Dynamic pressure is employed for this traffic class. 


e Guaranteed bandwidth (GBW)—Iraffic flows that require a guar- 
anteed amount of bandwidth over a relatively long time interval. 
Over short periods, the network may lag or lead in providing this 
bandwidth. Bandwidth meters may be inserted onto links in the 
NoC to regulate these flows, using either of the two methods. If the 
flow is assigned high pressure, the meter asserts backpressure (flow 
control) to prevent the flow from exceeding a maximum bandwidth. 
Alternatively, the meter can modulate the flows pressure (priority) 
dynamically as needed to maintain an average bandwidth. 


e Best effort (BE)—TIraffic flows that do not require guaranteed 
latency or throughput but have an expectation of fairness. 
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* Note that in the NTTP packet, the pressure field allows more then one bit, resulting in multiple 
levels of preferred traffic. 


Networks-On-Chips Theory and Practice, https://vdoc.pub/download/networks-on-chips- 
theory-and-practice-embedded-multi-core-systems-6f26givv11f0, at 315-316. 


In addition, the Arteris Interconnect includes “a mechanism called rated adaptation, which stalls packets just 
enough to remove wait states from the packets, preserving a low latency.” For other traffic, the “[b]est effort 
traffic can be left untouched[,]|” “[I]atency sensitive traffic may have its urgency modulated as a function of 
the transaction[,]” “[s]oft real-time traffic may have its hurry level modulated as a function of the bandwidth 
it receives[,]” and “[o]n the real-time modem data port, the hurry is fixed at a critical level.” 


Those effects can be mended by the insertion of buffering. In the case of peak bandwidth 
reduction, a simple FIFO does the job: Busy states present at the output of the FIFO do 
not propagate back to the input until the FIFO is full. For a peak bandwidth increase, the 
situation is a bit more complex. In a FIFO, wait states present at the input are only absorbed 
when the FIFO is not empty. Arteris proposes a mechanism called rate adaptation, which 
stalls packets just enough to remove wait states from the packets, preserving a low latency. 

In this second step, the architecture is modified to introduce some buffering. In our ex- 
ample 760 bytes of memory have been distributed across the topology. Some have been put 
on existing links; some required the creation of new links. 


Application driven network-on-chip architecture exploration & refinement for a complex SoC, 
https://www.arteris.com/hs-fs/hub/48858/file-14363521-pdf/docs/springer- 


appdrivennocarchitecture8.5x11.pdf, at p. 16. 
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For the other traffic, the configuration can be done in architecture. 


e Best effort traffic can be left untouched. 

e Latency sensitive traffic may have its urgency modulated as a function of the transaction: 
Normal for writes and important for reads. 

e Soft real-time traffic may have its hurry level modulated as a function of the bandwidth 
it receives: Critical until a specified bandwidth is obtained on a sliding 4 microsecond 
window, and normal thereafter. These settings are set through configuration registers and 
may be modified while the interconnect is running. The mechanism is called a bandwidth 
regulator. 

e On the real-time modem data port, the hurry is fixed at a critical level. 


Id. at 18. 


As a further illustration, the Arteris NoC implements QoS mechanisms that performs arbitration 
based on “Bandwidth Regulartor (BR)” and “Bandwidth Limiter (BL)”: 


113 


4857-2658-6177.3 


Case 2:22-cv-00481-JRG Document 1-31 Filed 12/19/22 Page 114 of 114 PagelD #: 1540 


U.S. Patent No. 8,086,800 (Radulescu and Goossens) 
“Integrated circuit and method for buffering to optimize burst length in networks on chips” 


Bandwidth Limiters and Rate Regulators 


Many times architects will want to implement QoS within their SoC but the QoS 
prioritization data is not available from the individual IP blocks. In this case, QoS 
information may be generated from within the NoC interconnect using Arteris’ QoS 
Generator. The QoS Generator can instantiate sophisticated, and software 
programmable, means to regulate interconnect QoS, including: 


> Bandwidth Limiters - Bandwidth limiters cause a socket to stop accepting 
requests when a run-time programmable throughput threshold has been 
exceeded. 

> Rate Regulators - Rate regulators cause a socket's transactions to be demoted 
when a bandwidth threshold is reached. This can be considered a smoother 
version of the bandwidth limiter because transactions are only demoted 
instead of stalled. 


https://www.arteris.com/end-to-end-quality-of-service-qos 
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